Region based analysis of video sequences with a general merging algorithm

Connected operators [4] and Region Growing [2] algorithms have been created in different context and applications. However, they all are based on the same fundamental merging process. This paper discusses the basic issues of the merging algorithm and presents different applications ranging from simple frame segmentation to video sequence analysis.Peer ReviewedPostprint (published version

Connected operators based on region-tree pruning strategies

This paper discusses region-based representations useful to create connected operators. The filtering approach involves three steps: 1) a region tree representation of the input image is constructed; 2) the simplification is obtained by pruning the tree; and 3) and output image is constructed from the pruned tree. The paper focuses in particular on the pruning strategies that can be used depending of the increasing of the simplification criteria.Peer ReviewedPostprint (published version

Connected operators for sprite creation and layered representation of image sequences

This paper proposes and discusses the use of motion-oriented connected operators for sprite creation. Motion-oriented connected operators are tools allowing the simplification of frames by removing objects that do not follow a given motion. They combine features of filtering and segmentation tools. They are, however, less computationally expensive than most motion-oriented segmentation algorithms. In this paper, we show how they can be used to efficiently remove outliers with respect to the dominant motion and to create layered representation of sequences.Peer ReviewedPostprint (published version

Auto-dual connected operators based on iterative merging algorithms

This paper proposes a new set of connected operators that are autodual. Classical connected operators are analyzed within the framework of merging algorithms. The discussion highlights three basic notions: merging order , merging criterion and region model. As a result a general merging algorithm is proposed. It can be used to create new connected operators and in particular autodual operators. Implementation issues are also discussed.Peer ReviewedPostprint (published version

Stereo image analysis using connected operators

Connected operators are increasingly used in image processing due to their properties of simplifying the image with various criteria, without loosing contour's information. These properties are related to the connected operator approach that either preserves or completely eliminates a determined connected component, according to an established criterion of analysis. In this paper we will define a new connected operator for stereo images. The goal is to simplify one of the images (left) in the sense that the operator will eliminate the image components that are not present at a determined location in the other image (right). This filter let us select in a stereo image, objects as a function of their distance from the observer (for instance used in auto guided vehicles).Peer ReviewedPostprint (published version

Motion connected operators for image sequences

This paper deals with motion-oriented connected operators. These operators eliminate from an original sequence the components that do not undergo a specific motion (defined as a filtering parameter). As any connected operator, they achieve a simplification of the original image while preserving the contour information of the components that have not be removed. Motion-oriented filtering may have a large number of applications including sequence analysis with motion multi-resolution decomposition or motion estimation.Peer ReviewedPostprint (published version

Segmentation and tracking of video objects for a content-based video indexing context

This paper examines the problem of segmentation and tracking of video objects for content-based information retrieval. Segmentation and tracking of video objects plays an important role in index creation and user request definition steps. The object is initially selected using a semi-automatic approach. For this purpose, a user-based selection is required to define roughly the object to be tracked. In this paper, we propose two different methods to allow an accurate contour definition from the user selection. The first one is based on an active contour model which progressively refines the selection by fitting the natural edges of the object while the second used a binary partition tree with aPeer ReviewedPostprint (published version

Representing and retrieving regions using binary partition trees

This paper discusses the interest of Binary Partition Trees for image and region representation in the context of indexing and similarity based retrieval. Binary Partition Trees concentrate in a compact and structured way the set of regions that compose an image. Since the tree is able to represent images in a multiresolution way, only simple descriptors need to be attached to the nodes. Moreover, this representation is used for similarity based region retrieval.Peer ReviewedPostprint (published version

Image sequence analysis and merging

Peer ReviewedPostprint (published version

Antiextensive connected operators for image and sequence processing

This paper deals with a class of morphological operators called connected operators. These operators filter the signal by merging its flat zones. As a result, they do not create any new contours and are very attractive for filtering tasks where the contour information has to be preserved. This paper shows that connected operators work implicitly on a structured representation of the image made of flat zones. The max-tree is proposed as a suitable and efficient structure to deal with the processing steps involved in antiextensive connected operators. A formal definition of the various processing steps involved in the operator is proposed and, as a result, several lines of generalization are developed. First, the notion of connectivity and its definition are analyzed. Several modifications of the traditional approach are presented. They lead to connected operators that are able to deal with texture. They also allow the definition of connected operators with less leakage than the classical ones. Second, a set of simplification criteria are proposed and discussed. They lead to simplicity-, entropy-, and motion-oriented operators. The problem of using a nonincreasing criterion is analyzed. Its solution is formulated as an optimization problem that can be very efficiently solved by a Viterbi (1979) algorithm. Finally, several implementation issues are discussed showing that these operators can be very efficiently implemented.Peer ReviewedPostprint (published version